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(57) ABSTRACT 

Asecurity and surveillance system for aircraft on the ground 
incorporates a plurality of strategically spaced sensors 
including video imaging generators, audio sensors, motion 
detectors, and fire and smoke detectors for monitoring 
critical components and critical areas of both the interior and 
the exterior of the a commercial transport such as an aircraft. 
The captured data and images are transmitted to a ground 
based security station for display on a monitor and may be 
recorded on a "black box" recorder as well as on a ground 
based recording system. The multiple audio and image 
signals are multiplexed and sequenced utilizing split screen 
technology in order to minimize the recording and monitor- 
ing hardware required to process the images. 

63 Claims, 16 Drawing Sheets 
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GROUND BASED SECURITY 
SURVEILLANCE SYSTEM FOR AIRCRAFT 
AND OTHER COMMERCIAL VEHICLES 

CROSS REFERENCE TO RELATED 
APPLICATIONS 

This application is a related to my copending applications 
entitled: Wireless Transducer Data Capture and Retrieval 
System for Aircraft, Ser. No. 08/745,536, filed on Nov. 12, 
1996; Video and Data Capture Retrieval Surveillance Sys- 
tem for Aircraft, U.S. Ser. No. 08/729,139, filed on Oct. 11, 
1996; and Acoustic Catastrophic Event Detection and Data 
Capture and Retrieval System for Aircraft, U.S. Ser. No. 
08/738,487, filed on Oct. 28, 1996 now U.S. Pat. No. 
5,798,458, and my copending applications Apparatus for 
and Method of Collecting and Distributing Event Data to 
Strategic Security Personnel and Response Vehicles; 
Ground Link with On-Board Security Surveillance System 
for Aircraft and Other Commercial Vehicles; and Network 
Communication Techniques for Security Surveillance and 
Safety System, filed on even date herewith. 

BACKGROUND OF INVENTION 

1. Field of Invention 

The subject invention is generally related to safety and 
surveillance equipment for aircraft, railroad rolling stock, 
ships and other commercial vehicles and is specifically 
directed to a comprehensive multi-media security surveil- 
lance system for same while in port or terminal and/or 
unattended whether taxiing or parked. The system of the 
subject invention also permits tracking while en route. 

2. Discussion of the Prior Art 

Security is of ever increasing importance. This is particu- 
larly true with respect to commercial airlines as more and 
more people and freight are moved in this manner and 
aircraft and other commercial transports increasingly 
become the targets of terrorists activities. The airways are 
becoming increasingly crowded with traffic. Global tracking 
systems are now in place to monitor the flight of the aircraft 
from the moment it lifts off until it safely lands at its 
destination. Radar and navigational positioning systems are 
commonplace both on the aircraft and at the ground tracking 
stations. All of these electronic systems have increased the 
overall safely record of commercial traffic to new standards 
as the number of miles flown continues to escalate. 

In addition, the on board avionics including electronic 
monitoring and diagnostic equipment, particularly on large 
commercial jets, continues to evolve, giving both the on 
board crew and the ground assets more complete, accurate 
and up to date information regarding the condition of the 
aircraft while in flight. Flight recorders long have been 
incorporated in order to provide a record of each flight and 
in order to provide critical information to aid in the deter- 
mination of the causes of an accident or malfunction should 
one occur. 

However, one area which has been neglected with the ever 
increasing availability of electronic surveillance is the secu- 
rity of the aircraft or other vehicles or vessels, including, but 
not limited to, over-the-road vehicles, railroad rolling stock, 
ships and other commercial transports (collectively referred 
to as commercial transports), particularly when unattended. 
Typically, when an aircraft is on the ground, or in port, and 
unattended the only security provided is the security of the 
location. If the security of the area in which the commercial 
transport is stored is breached, the commercial transport is 
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an easy target. In most cases, even the access doors are left 
open and further, for obvious safety reasons, arc designed 
not to be locked from the outside. Many critical areas of the 
commercial transport are left exposed such as in an aircraft, 

5 by way of example, the landing gear, the engine housing and 
critical wing and tail components. 

With terrorism and sabotage an increasing problem there 
is significant need to develop an integrated system capable 
of providing good physical/visual and/or audio surveillance 

10 as well as monitoring of the environmental, security and 
motion conditions of the commercial transport and various 
components while the commercial transport is on the 
ground. For example, a good visual surveillance system 
would give instant evidence of a breach of commercial 

15 transport security, could sound an alarm and could imme- 
diately secure the area. 

Such a system would also permit the recording of visual 
information to provide a history for later review, providing 
yet another source of information for increasing the overall 

20 security of commercial transportation. 

While such a system would be of great benefit to the 
commercial transport and airline industries in general and to 
the commercial airlines in particular, there are no integrated 

^ systems currently available which adequately meets these 
needs. 

SUMMARY OF THE INVENTION 

The subject invention is directed to a comprehensive 

30 multi-media safety, tracking and/or surveillance system, 
which in the preferred form provides both visual and/or 
audio information as well as critical data such as location, 
direction, intrusion, fire and/or smoke detection and/or status 
of environmental conditions and/or transport systems status. 

35 In my aforementioned patent and copending applications, 
incorporated herein by reference, detection and sensor sys- 
tems are utilized to provide the flight crew and/or a ground 
tracking station for commercial aircraft critical information 
during flight and/or to record the information and data 

40 generated during flight for later reconstruction of cata- 
strophic events. The subject invention is an expansion of this 
concept and adds not only ground security and surveillance, 
but tracking while in port or on the ground as well as while 
in route, as well as incorporating the onboard systems of the 

45 aforementioned patent and applications. It is an important 
feature of the invention that the transmitting network for 
provides a comprehensive communications link between 
stationary and mobile stations on the ground, the craft or 
vehicle being monitored and strategic sensors both onboard 

50 the commercial transport and the sensors on the ground. In 
the preferred embodiment of the invention, a wireless LAN 
(local area network), WAN (wide area network) or other 
wireless transmission scheme is used as the transmission 
system of choice. A digital wireless voice intercom is 

55 provided for security purposes and for communication 
between the onboard crew and the ground based personnel. 
In the preferred embodiment video intercom is also pro- 
vided. Digital wireless telecommunication capability pro- 
vides for text communications. Digital wireless (such as, by 

60 way of example, LAN) based file communication capability 
permits the transmission of information such as route or 
flight plans or gate and dock information. As an example, a 
LAN or WAN has worldwide tracking capability adapted to 
be used in connection with a global satellite communication 

65 system such as IRIDIUM, wherein the entire path and status 
of the commercial transport may be monitored while air- 
borne over satellite connections. While wireless systems 
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provide the preferred form of communication, many features heading, speed and other navigational information to the 
of the invention may be practiced using other communica- FAA and other operators and computer tracking and moni- 
tion links within the scope and spirit of the invention. toring stations, thus enhancing collision avoidance informa- 

One important feature of the invention is the ability to tion. 
remotely monitor a commercial transport while on the s Situational awareness is also provided by the subject 

ground whether or not the commercial transport is attended^ mVentjoa M ^ ansp0 rts in the terminal area are provided 

This wiU permit detection of unexpected events, breach of ^ Gps , oca , ion sensof ^ , ha , the bome or d 

security, change in environmental conditions and other ^ ^ be &ack and identify [he localion of ev 

actmt.es both on and m the vicinity of the commercial terrainal eg ^ flQW rf ^ 

transport. A GPS system may be included to provide accu- ,o ^ercial transports in the terminal area, assuring that 
rate positioning information of the commercial transport, . . r . . . . . . 4 , u 

...... , , - 4 . fi , lt proper distance is maintained and appropriate pathways are 

establishing the parked position of the commercial transport followed 
at any time, as well as tracking its movements. 

In its preferred form, a plurality of sensor units, which ™ e » bo P ermils 6,11 situa,ional rareness capa- 

may include at least one video or image sensor/device and/or 15 bdity where all ground or water transports in the are pro- 

at least one audio sensor and/or at least one motion sensor, v,ded GPS 1 ° catl0 ° ""formation such that the ground 

_ i ^ „ t ^ t ^ M \u, „i , ,u„ i n c ,u a crew will know where all assets are at any point in time. Inis 

are placed strategically about the interior and exterior ot the . , , , „. . J f „ _ , t 

commercial transport and at strategic ground based loca- can P ravlde both collision avoidance as described and also 

tions. In addition, strategically placed motion detectors, fire c A heck lo assure that * c transports are m an authorized area, 
sensors, smoke sensors, door or latch sensors and other 20 composite of all transport location _ information can be 

monitoring equipment are incorporated in the system. A used }° P r ° v,dc a . ' hvc display of all assets in the area 

comprehensive system incorporating these various sensing f^S. of . thl * '"formation will provide good archival 

devices provide a broad based, multi-media safety, security "formation in the event a reconstruction of events, such as 

and surveillance system for monitoring commercial trans- a " aa *» breacb or coU,slon - 15 re< l uircd - 
ports at any time, whether or not attended. 25 The comprehensive multi-media system of the subject 

In addition to safety and/or surveillance issues, the com- invention permits the collection and dissemination of virtu- 

prehensive data collection scheme of the subject invention ally a11 data associated with the commercial transport at any 

provides a system permitting enhanced monitoring and/or time - both while m P 01 } or > n In *» Preferred 

response to crew generated work orders or re-supply orders, embodiment a combination of sensors systems are used, 

and may even avoid tbe requirement that the crew order 30 witn sensors bein S insUlled Wltbul *» transport, on its 

certain supplies. For example, by monitoring the fuel, fresh exterior ^ al ground-based locations for momtonng the 

water, waste water and/or hydraulic levels onboard and transport when is in port. In such areas where ground based 

transmitting this to a ground station, refueling, water deliv- s y stems are not available, the transport-installed systems 

ery and/or hydraulic fluid check and supply may be initiated suU P rov 'de useful and enhanced information over the prior 

by the station crew and prepared for delivery when the 3 s **• Likewise, in those areas where unequipped transports 

commercial transport arrives in port. The performance enter a system equipped port, the ground based system of the 

parameters of the commercial transport may also be moni- sub i e c' invention can communicate via standard ground-to- 

tored and may be utilized for initiating maintenance air radio to provide useful information such as perimeter 

procedures, for example, even before the commercial trans- surveillance and the like. For example, even without the use 

port is in port. Pre-flight or pre-mission checklists may be 40 of aboard systems, the identification number (such as the 

enhanced or automated by monitoring tbe critical functions ,a " number on an aircraft), owner, state or country of origin 

and criteria via the system of the subject invention. The and other identifying information can be matched with 

system of the subject invention greatly enhances mainte- available data to provide immediate and accurate identifi- 

nance procedures and efficiency. Where desired, the system cat ion of a specific commercial transport. This permits 

is capable of permitting the commercial transport to carry its 45 efficient trackin 8 and response capability of the transport in 

detailed maintenance record onboard, permitting full access P 0 ", on the ground, or anywhere in the world using satellite 

to such information at remote locations. The maintenance communicanons. 

record can be routinely updated or polled from the home In the preferred embodiment, fixed view and steerable 

based maintenance station using the system's unique uplink video cameras may be incorporated either on the commer- 

capability. The ability to both send and receive information so cial transport or independently of the transport at ground 

will support remote control of the commercial transport based sites where commercial transport is located in order to 

onboard systems such as lighting, strobes, alarm setting/ monitor movements around tbe perimeter, of the monitored 

resetting, environmental controls, locking systems, siren or commercial transport. It is also desirable to include focusing 

other audible signals, fuel flow, fire detection and the like. and/or timing functions so that selective pan, tilt and/or 

Once in port, the system of the subject invention permits 55 zoom (x.y.z) positioning can be utilized. The cameras may 

complete monitoring of on ground movement, and allows be activated and/or aimed and/or focused based on the 

the monitoring of other commercial transport in the area to location data provided by a GPS system integral to the 

assure that the various transports do not interfere with one monitored commercial transport, may automatically pan an 

another. This provides collision avoidance, and can be area, or may be manually operated by crew or ground 

utilized both on the ground and in the air or in route via 60 personnel. Automatic tracking of each transport in the ter- 

water or land. Current airborne collision avoidance is minal by one or more tracking cameras in conjunction with 

accomplished by use of a radar transponder. Aircraft posi- a recording device can provide an archival record of each 

tion is located by radar "echo" response and altitude by a asset in case of a detrimental event, such as fire, terrorist 

"reporting altimeter" reading being returned to the radar event, theft, collision and the like. 

system encoded in tbe transporter return. Use of a satellite 65 Several video cameras may be placed such that tbe lens of 

based LAN or WAN will provide an "intranet in the sky", each is aimed through a window opening provided in the 

pioviding much more accurate GPS position, altitude, fuselage or body in order to provide video imaging of the 
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engines, tail section, and/or landing gear and other func- port from a remote location. The deployable device is then 

lional components of an aircraft. Cameras may be placed retrieved and stowed in the commercial transport when the 

throughout the interior of the commercial transport on the commercial transport departs from the site, 

flight deck, in the cargo hold in passenger cabin and/or other ,„ ^ fcrred embodimenl> ^ system will transmit any 

desired spaces including on the ground outside the commer- 5 detec(ed ^ form4tion t0 , m0 nitorsystem located at a ground 

cial transport. The aud,o sensors transducers and/or other & ^ Mmw ^ re B w j |hill 

sensors and detectors are also strategically located through- , . . , * " * r I . . 

... ■ ■ i i . . • the terminal, tower and/or safety sites such as security 

out the commercial transport and positioned at strategic 4 . ' _ c 

. . . . , . / , i f * i_ Cm i c.i stations and fire stations. Detection of activity or fire can 

locations both internal and external of the fuselage. External . . . , \ 

« » .1 , j. 4 r sound local and/or remote alarms and/or dial emergency 

sensors based on the ground area surrounding the commer- in . ~ , . , , , t . . * _* 

. . . . i u j j j 10 numbers. The data may also be recorded on the standard 

cial transport may also be added. , . , , . , ... _ 

T . T , , , recorders provided onboard the commercial transport and/or 

In its simplest form, current sensors are already on the Qn d based recorde[s of CODVeDlional type digita , type 

commercial transport coupled with strategically based of , , ef based , ; The security station has 

ground sensors and may be used to provide surveillance Uve access tQ aU of ^ . ^ audio s{ a]s M 

and/or warning system. Thus a basic system may be unple- 15 , h are ^ b , he ^ an(J where ^ lhe 

mented with a minimum of alteration to the commercial commercial t rt recorder ^ make an record 

transport and a mmiraum of expense. of me fof archjve purposes random ace8SS 

Withm the commercial transport, the system may be recording techniques are used, such as, by way of example, 

hardwired or may use wireless transmission and receiving digitaJ random access memory storage devices, the infor- 

systems. The wireless system is particularly useful for 20 ma tion by be readily searched for stored information, 

adapting the system as a retrofit on existing equipment and . , . , . .. . 

.... >, j „„.„,• „ ? t At . - If unauthorized personnel breaches the secunty area and 

also provides assurances against disruption of data trans- ••■ 

mission during structural catastrophes such as fire or air- *e audio and/or v.deo equipment is activated, signals w, 

frame breakup. In the preferred embodiment, the wireless * ln ?mediate y transmitted to the secunty Nation This will 

system is fully self-contained with each sensor unit having 25 g,v f ™ m6dlate t0 mforaation identifying the activity 

• 1 j » i * I «. and the personnel involved. Further, in the preferred 

an independent power supply and where appropriate, a . * m c . . . ' *n i_ 

• • 1 . r j ,., • . embodunent of the invention, an alarm system will be 

sensor light source. The ground sensors may likewise be . . , c . \. 4 ■ ' , . 

■ ••j • ■ . j .. c activated for securing the immediate area and taking counter 

hardwired or use wireless transmission and receiving of i_ . .■ c 

•j j/ • . , , ^ , ° . measures to tighten security such as remote operation of 

video and/or alarm telemetry signals. The ground security . , , ■ & A \ . . . c 

. , j ... . . ... lights and doors, and respond to a breach 01 same. 

system may include motion sensitive, weight sensitive, 30 F 

infrared sensitive, audio sensitive, or other typed activation In the one embodiment, information from the plurality of 

system so that the equipment is not activated until some sensors on the transport is synchronized through an on board 

event is detected, i.e., the system is action triggered. The capture/multiplexing system whereby the plurality of data, 

ground communications link, monitoring and/or recording including visual image data, may be displayed, recorded, 

systems for collecting and/or transmitting the data as dis- 35 and/or transmitted in either a split screen or serial fashion, 

closed in my copending applications may be adapted for A "lime-stamp" or chronology signal may also be incorpo- 

processing the information gathered by the on-ground secu- rated m ^ data scheme. Any signal which is capable of 

rity system and, in the preferred embodiment. The wireless bem 8 captured and stored may be monitored in this manner, 

system may use radio frequency transmission and may Utilizing the wireless system of the invention in corabina- 

incorporate the wireless communication system already in 40 tlon lhe batter y back * u P P ower su PPly> [{ is P ossible 10 

place as an integral component of the system. Where continue collecting information without using ground power 

desired, a wireless local area network (LAN) or other or commercial transport power. This assures that the system 

wireless system may also be utilized for intercommunication wUl °P erale even if P ower * disrupted for any reason sucb 

among the system components. Preferably, the entire as,by way of example, tampering by unauthorized personnel 

capture, retrieval, monitor and archive system is installed 45 or b y &c - In its sim P leSt form > onl y tri gg ered (activated) 

utilizing the wireless transmitting/receiving system in order sensors are active > i e » an activit y al the Slte causes a 

to assure that transmission will not be lost in the event of a triggermg effect and activates the sensor, and only the 

power shutdown or a failure causing possible open or si S naIs generated thereby are transmitted to the security 

shorted circuit conditions which could occur in a hard wired station - In sucb a system, multiplexing of continuous signals 

system. 50 ^ DOt ncar ty critical. The "time-stamp" is particularly 

A commercial transport equipped with the ground sur- ™cM** ™ ^ ™ reconstructing the events in a "post-event" 

veillance system of the subject invention may not always be investigation. 

located at a port or terminal equipped with a ground security I Q me one embodiment, the system includes a plurality of 

system. In the preferred embodiment of the invention, the strategically located video image sensors and/or audio 

on-board system is self-contained and can operate on a 55 sensors, each sensor adapted for transmitting the signals to 

stand-alone basis at sites where compatible comprehensive a multiplexer for distributing the signals to monitors and/or 

electronic ground security is not available. In those sites archival recorders. The data multiplexer combines all of the 

with a compatible ground surveillance system, the on-board signals from the various detector circuits to provide a data 

system communicates with the site-based system to provide stream suitable for transmission over the wireless system, 

information to airport ground personnel and security per- 60 The LAN transceiver is the interface into the LAN. The 

sonnel. The system of the present invention also lends well LAN transceiver can accept software downloads from vari- 

lo a deployable surveillance device carried by the transport, ous system elements to enable the multi -media sensor sys- 

which can be deployed at unequipped sites to permit off- tem to be maintained or upgraded to perform other func- 

craft monitoring while the commercial transport is at the tions. Other sensors may also be incorporated in the system, 

port or terminal. The system can be positioned at a strategic 65 such as motion sensors, smoke and/or fire sensors and the 

location within the site whenever the commercial transport like. The system is configured for selectively transmitting all 

is unattended to permit monitoring of the commercial trans- of the data on a "real-time" or "near real-time" basis, i.e., the 
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data is delivered with only delays for processing time such 
as compression/decompression, multiplexing and the like. 
The system is also adapted to provide the monitors access to 
serial, synchronized full screen view of each of the cameras, 
in sequential viewing, or alternatively to provide split screen 
or mulii-monitor viewing of a plurality of cameras. The 
system may be hardwired or wireless transmission may be 
utilized to further minimize the possibility of a malfunction 
at the onset of a catastrophic occurrence and to make the 
system more tamper resistant. 

The comprehensive surveillance/communication of the 
subject invention supports communication of monitored 
data and/or commands or operational data between the 
ground or base station and the transport, between the trans- 
port and ground or terminal support vehicles and/or 
equipment, between the transport and various monitoring 
stations or systems, between transports, between the ground 
station and the support vehicles, between the monitoring 
station and support vehicles and between the monitoring 
stations or systems and the support vehicles. This permits 
the ground station to monitor and/or determine the identity, 
location, and heading of any vehicle in its range for tracking 
and collision avoidance, as well as monitoring sensor 
information, alarm conditions, emergency conditions, ser- 
vicing requests, maintenance information, navigational 
information, requests for information such as flight plans, 
weather information, route maps, message traffic such as 
e-mail and the like. Similar information may be transmitted 
and received between transports, between transports and 
support vehicles and any of these and the ground station. The 
ground station may also send operational commands to the 
various monitoring systems both onboard the transport and 
ground mounted, such as camera tilt, pan and zoom and 
sensor activation. Other command signals such as "lock-on" 
a specific condition or transport, sensor download, activation 
such as "lights-on" or alarm (e.g., siren) activation and the 
like. 

In a typical application, when an alarm from a specific 
transport is sent to the ground station it will be tagged with 
the GPS coordinates of the transport. The alarm will also be 
reported to a security system, typically including a comput- 
erized center that distributes the information of the wireless 
LAN and where used, the wired LAN. The mobile and/or 
personal security units will also report their GPS coordinates 
to the central computer so that the system knows the location 
of all security personnel at ant point in time. Once the alarm 
signal is received, the system can search and identify the 
closest appropriate personnel and alert them of the alarm 
condition. This is accomplished by calculating the length of 
the vectors between the transport GPS and the various 
personnel GPS signals. The shortest vectors arc the nearest 
personnel and these can be alerted to respond to the alarm 
condition. 

The selected personnel are then signaled by the security 
system of the present invention to respond. Audio, text and 
graphic communications may be utilized to inform the 
selected personnel of the condition and location. The system 
can also use its "mapping" function to assist the personnel 
in determining the best route to take in response. Because of 
the em comprehensive nature of the system of the subject 
invention, both audio and image conditions of the transport 
can be communicated directly to the selected personnel, 
using video conferencing compression techniques of the 
LAN. If the desired, the personnel can switch cameras to 
obtain different views, or gain control of the steerable 
camera disclosed herein and survey the scene as appropriate 
via remote control. The two-way communication capability 
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of the system would also permit the personnel to commu- 
nicate conditions and the need for additional personnel or 
equipment both to the system computer and directly to other 
personnel. 

5 The security computer system will register the GPS 
location of the selected personnel as well as the location of 
additional or "back-up" personnel in order to coordinate 
their movements and actions. The system can then provide 
essential audio, video and communications to the selected 

10 back-up personnel in order to coordinate the entire opera- 
tion. The coordinates of fixed sensors may also be entered 
into the system so that personnel can determine the prox- 
imity of each available sensor to his GPS location. 

It should be noted that the request for back-up can be 
programmed to be automatically activated under certain 

1 conditions. For example, if a security personnel personal 
system detects an explosion or a gunshot, an automatic 
alarm condition can be activated to alert central security 
other personnel in the vicinity to indicated "potential bomb 
blast" or "potential automatic weapon" , all based on the 

20 audio signal which is picked up by the sensors by comparing 
them to known acoustic signatures of these types of events. 

Shock and vibration detectors may also be included both 
on board, at fixed locations on the ground and in the portable 
or mobile units. For example, if a personal unit is dropped, 

25 an alarm would be generated. Smoke and heat detectors may 
also be incorporated to monitor the safety of the environ- 
ment of personnel. 

It is a primary object of the subject invention to provide 
the means and apparatus for a comprehensive, multi-media, 

30 wireless surveillance and monitoring system for monitoring 
and tracking a commercial transport vehicle while in port or 
while in route. 

It is a further object and feature of this invention to 
provide a comprehensive surveillance and monitoring sys- 

35 tem supported by a wireless transmission system whereby 
communication of all data including live video and/or audio 
transmissions can transmitted between the transport, ground 
or base stations, remote sensor systems, remote or mobile 
monitoring systems and other transports. 

40 It is another object and feature of this invention to provide 
tracking capability to assure that a transport stays in an 
assigned zone while either in route or in the port or terminal. 
It is a further object and feature of this invention to 

45 provide communication capability for monitoring and/or 
responding to supply needs on board the transport in order 
to permit support personnel to expedite response and/or 
re-supply when the transport arrives in port. 
It is also an object and feature of this invention to provide 

50 for monitoring of situational conditions of and surrounding 
the transport both while in port and while in route. 

It is yet another object and feature of this invention to 
provide means for archiving performance parameters for 
later recall in order to review performance and/or recon- 

55 struct events. 

It is an additional object and feature of this invention to 
provide a ground surveillance and security system for 
detecting the breach of commercial transport security while 
the commercial transport is on the ground or in a port or 

50 terminal and is unattended. 

It is another object and feature of the subject invention to 
identify that a commercial transport is on the ground and 
needs to be monitored for tracking its exact location, and its 
orientation on the ramp. 

65 It is also an object and feature of the subject invention to 
provide a security system, which is integral with the com- 
mercial transport for providing ground security. 



06/23/2003, EAST Version: 1.04.0000 



US 6,545,601 Bl 

9 10 

II is a further object and feature of the subject invention board systems with the comprehensive tracking and moni- 

to provide comrnunicalions between the commercial trans- toring system of the subject invention, 

port and a ground security station to assure commercial f[Q g shows a typical ground based system, 

transport security while the commercial transport is parked FIGS 0 fe aQ expansion of the syslem shown m FIG . i 

or unattended. 5 umfcujg a remote receiver and monitor station in combina- 

It is another object and feature of the subject invention to \j on with hardwired ground components, wireless ground 

provide a comprehensive, multi-media data generating, components and an aircraft system interface, 

collecting, displaying, transmitting receiving and/or storage nG 1Q [s a sim lificd diagrammatic iUustration of a 

safety and/or surveillance scheme for commercial transport. ^ ^ Qf WAN Qe(worked system i^trating lhe 

It is also an object and feature of the subject invention to versatility of information transmission and monitoring capa- 

provide an on ground security system which incorporates the bilities. 

in-flighi surveillance syslem in order to minimize the num- FIG. 11 is a diagrammatic illustration of the system being 

ber of additional components required to implement the used fa , uxj prolection and/or tracking mode . 

system. ^ FIGS. 12a, 12b and 12c are illustrations of various system 

It is afco an object and feature of the subject invention to for and loca i ^ netW ork 

store video, images, audio and/or transducer data on the fW-LAhO systems 

commercial transport being protected and/or at the ground , ' , ,. 

security station 13 is a detailed diagram of the onboard surveillance 

_. .... . system for use in connection with transport two-way radio 

It is yet another object and feature of the subject invention m ^ ^ ^ rf F , GS m 

to provide apparatus for permittmg ground and/or base ^ 
personnel to receive video, images, audio information and/or 

data relating to critical components and areas of a commcr- * * Q integrated sensor/wireless LAN subsystem 

cial transport and operational data such as dispatch infor- usin 8 DSP technology. 

mation. 25 ^ * s a ^ a g rammauc illustration of the positioning 
It is still another object and feature of the invention to of tracking sensors on the ramp, particularly well-suited for 
permit the monitoring, storing and retrieval of any of a trackin & assets wilhout internal positional or tracking sen- 
variety of video, images, audio signals and/or performance sors * 

data by the tracking, surveillance and/or imaging equipment FIG. 16 is a diagrammatic illustration of the selection 

on board the commercial transport. 30 process techniques for identifying and alerting personnel 

Other objects and features of the subject invention will be u P on the occurrence and detection of an event requiring 

readily apparent from the accompanying drawings and response. 

detailed description of the preferred embodiments. DETAILED DESCRIPTION OF THE 

BRIEF DESCRIPTION OF THE DRAWINGS 35 PREFERRED EMBODIMENTS 

FIG. 1 is a basic diagram of a ground based security and It will be readily understood that the various components 

surveillance system incorporating the teachings of the sub- and features of the subject invention can be utilized in 

ject invention. connection with a tracking, security and/or surveillance 

FIGS, la and 26 are diagrams of a simplified, basic s V stem for an V of a variet y of commercial transports. For 

camera/transmitter to base station system utilizing a con- 40 Ptoses of brevity, the features of the invention are 

ventional wireless transmission syslem between transport described in detail herein as applied to commercial aircraft, 

and the base station, and adapted for converting generally ™» » Primarily because it is assumed that aircraft systems 

incompatible systems in order to make the system of the are l*ely to incorporate the most complex and comprehen- 

subject invention of universal application. sive surveillance systems of the subject invention due to the 

1 j 1L j- " r i-c j i_ 45 importance of securing this commercial transport while on 

FIGS. 3a and 36 are diagrams of a simplified, basic * , . . . 6 . ^ A r . ., , 

t , , . .. . j- •» 1 • 1 . the ground and both the importance and complexity of 

camera to base station utilizing a digital wueless transmis- ° . , , . . K ... . . J _ 

. . c i «. . . 1 1 • monitonne and tracking same while in port or in route. The 

sion system such as, by way of example, a digital radio, . & , . , & % a a a a- 

• 1 j- 1 i am *u • 1 • *• system may be scaled up or scaled down depending upon 

wireless digital LAN or other wireless communication sys- a £ plication y Fof examp ,^ |and vehides ^ „ 

% t 50 rolling stock or over the road trucks may need only door 

FIGS. 4a and 46 are diagrams of an expanded system mmion sensQrs afld bfake monitors> whereas 

similar to FIG. 36, but showing use of an on-board hard- aircraft ^ described> wiU requir e a substanUally more 

wired system and on-board wireless system, respecuvely. comprehensive system in order to provide adequate surveil- 

FIG. 5 is a perspective view of a multimedia camera lance . r n me preferred embodiment for aircraft as described 

tracking system for use in connection with the subject 55 m detail herein, lhe comprehensive surveillance system 

invention. utilizes the onboard aircraft system in combination with a 

FIG. 6 is an expanded system incorporating the teachings ground-based wireless system. The wireless configuration 

of FIG. 1, including a remote mobile security unit and can also be applied to the sensors on board the aircraft using 

utilizing a local area network (LAN) as the signal transmit- the same architecture as described here for the ground based 

ting and receiving system applied to the fixed components of so portion of the system. That is, the on board elements may be 

the system, a wireless network such as a wireless LAN hardwired, may communicate through wireless radio, or 

(W-LAN) for the signal transmitting and receiving system may utilize wireless LAN as herein described, or a combi- 

applicd to the mobile components of the system and a wide nation. The LAN radio provides a wireless LAN connection 

are network (WAN) as the signal transmitting and receiving to other system elements. This is a well-know but evolving 

system applied to distant components of the system. 65 technology that allows high bandwidth wireless data trans- 

FIG. 7 is an illustration of an aircraft as an exemplary mission between multiple devices. Several different tech- 
commercial transport and shows the incorporation of on niques are available from a variety of manufacturers, includ- 
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ing Raytheon Systems Corporation, the assignee of the video processing methods, or other circuitry so configured to 
subject invention. Many of these techniques may be utilized perform the processing by well-known techniques. When 
in the subject invention. the video processor/compressor is used for motion detection, 
The comprehensive system includes various condition any detection will generate a specified unique "alarm con- 
sensors, motion and audio detectors, video cameras, light 5 dilion" to be transmitted to other elements of the system, 
detectors, sound detectors, contact switches, temperature FIG. 1 is an illustration of a basic ground based security 
detectors and control systems for controlling light, and and surveillance system for aircraft. The aircraft 10, 10a, 
sound transmissions to the aircraft. A temperature and/or 10/>. . . 10/j will be within the view of video sensors or 
humidity detector may be used for general monitoring cameras 2 10, 210a. .. n when on the airport ramp. The video 
functions such as predicting the icing of the wings in winter 30 processor/compressor can also be used to perform still 
conditions, or for fire alarm functions. The temperature image compression to reduce the amount of data required to 
detector may be any known form for temperature transducer, be transmitted over the network. This can be accomplished 
such as a PTC, NTC, thermistor, or semiconductor element. by using any suitable image compression algorithm, such as 
More advanced semiconductor elements may be used, such the industry standard JPEG algorithm, wavelet compression, 
as integrated circuit types that may include integral tem- 15 DjVu from AT&T, or other techniques. For full motion video 
perature and/or humidity sensors, references, analog/digital surveillance applications, the compressor 406 may be used 
convenors, protocol engines and serial driver. Further, inte- to provide bandwidth reduction motion video transmissions, 
grated circuits can incorporate on-board digital radio ele- In this application, the amount of data representing a full 
ments such as DSP based radios to be completely integrated motion video stream would be reduced by using full motion 
self-contained chips. The temperature analog/digital conver- 20 video compression techniques such as Motion JPEG 
tor adapts the ambient temperature of the environment into compression, MPEG compression, motion wavelet 
a digital data stream. This digitizer runs at suitable rates for compression, or other techniques. This allows belter band- 
continuous temperature monitoring. A signal processor can width utilization of the wireless and wired communications 
be used to provide correction to the temperature and/or channel used by the system. 

humidity elements, such as processing out non-linear char- 25 The aircraft will transmit various identification signals, 
acteristics of the sensors. It can also be used to look for such as tail number, GPS location and the like, as indicated 
profiles such as rapidly rising temperature/humidity condi- at 12, 12<z ... n, to a ground based receiver 14. The camera 
tions that may indicate a fire or open door or other security 210, 210a . . . n will also transmit video signals to the 
breach. Detection of such an event would trigger a specified receiver 14, as indicated at 15, 15a . . . n. The location of the 
unique alarm condition to be transmitted back to other 30 cameras will be fixed, but may be either permanent locations 
elements of the system. or "drop and place" movable units dispatched as needed, 
One of the most significant factors in determining the based on changing security situations. It is also possible that 
overall complexity of the system is the cost associated with portable cameras will be transported by the aircraft then 
the various sensor components. For example, in certain deployed on the ground, permitting ground surveillance in 
applications it may be desirable to add a humidity detector 35 those airports where a permanent ground security system is 
or a carbon monoxide detector. A digital camera may be not installed. The GPS coordinates of ground based cameras 
used, or an analog camera may be used in combination with will be stored at the ground or base security station 18, or as 
an analog to digital convenor, or digital with internal digi- preferred in the case of drop and place units, will be sensed 
tization circuits, or digital compressed with an internal by on-board GPS receivers and transmitted to the base 
analog to digital convenor and a motion video compressor. 40 station. The received videos from cameras may be converted 
In the preferred embodiment, the camera runs at full-motion by optional convenor 16 as required and transmitted to the 
rates. However, it will be readily understood that the camera monitor of the ground based security station 18. The con- 
can run at lesser rates for still frame or step video applica- vertor is used to provide compatibility between the trans- 
lions. In all cases, accurate information can be supplied on port's format and the ground system format. For example, 
a "real-time" basis, i.e., the information can be transmitted, 45 for analog transmission an aircraft may transmit analog 
received and acted upon by man or machine in a timely NTSC video in the United States and PAL in England, 
fashion, sometimes with slight delays, to permit adequate Digital transmission may be accomplished by placing the 
response to an event. The video analog/digital convenor is convenors at each camera transmitting unit (see FIG. 3) 
functional to adapt the analog light modulated signal rep- thereby supporting digital data transmission for permitting 
resenting the video scene into a digital data stream. This 50 transmission by the preferred wireless digital system, such 
digitizer can run at "real-time" rates for processing full as a LAN or W-LAN. 

motion video, or could operate at lesser rates for still frame By monitoring the identification information from each 

or step video applications. The signal processor/motion aircraft, the transmitted video format from the various 

video compressor is flexible and will provide various func- cameras can be matched to a specific aircraft. The signal is 

tions depending upon application. For example, the video ss displayed on a monitor at station 18 where it can be viewed 

processor/compressor subsystem can be programmed to and monitored for surveillance and security purposes. In the 

perform functions such as motion detection in several well- event of a breach of security, security personnel may be 

known manners and methods. Several techniques are uti- readily dispatched to the correct aircraft using the GPS 

lized to accomplish motion detection, but the most general location signal to define an accurate position of the aircraft, 

method involves capturing repeated video frames and com- 60 As will be described, the security signals generated by the 

paring differences in those repeated frames over time. Other system of the subject invention may also be logged and 

techniques such as edge analysis, which looks for specific inventoried for later play back, which is particularly useful 

characteristics in the image, and the changes in such for reconstruction of events. It will be readily understood 

characteristics, may also be used. The processor/compressor that the ground components of the system may be hardwired, 

subsystem can also be used to image process the video for 65 or other forms of wireless communication, such as, by way 

purposes of contrast enhancement, dynamic range of example, a wireless local area network (LAN) could be 

improvement, noise reduction and/or other well-known utilized using radio frequency or optical communications 
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methods, as will be readily understood by those who are embodiment of FIG. 4b, the on-board network is also 

skilled in the art. The system can also be modified to wireless, such as the on-board LAN 592. In this 

transmit signals from the ground-based station 18 to the embodiment, a local wireless LAN transceiver 578 is used 

various ground sensors and aircraft sensor systems. For to send and receive signals between the various components 

example, a camera 210 can receive and respond to remote 5 suc h ^ camera 210 via a local (device dedicated) wireless 

positioning and zooming signals. Audio warning and acti- laJST transceiver 580. Of course, it will be understood that 

vation signals may be sent to the camera locations and to the ^ basc sUtion lan 530 can also be wired or wireless as 

aircraft to activate audio commands, sirens, lights and the a matler Q f choice 

like, which are integral to the system. nQ fi ^ a perspective view of a preferred embodim e n t of 

FIGS. 2a and 2b show two different schemes permitting 10 a nd based trackillg camera sensor 2 io. In the preferred 

transmission of monitor system data from a transport 10 to em5odiment> the cameras are adapted to resp0 nd to several 

a base station monitor 18 using a wireless transmission different types 0 f control signals, including but not limited 

scheme as indicated at 12. In FIG. 2a, the camera or sensor t0# 

(for example camera 29) produces a signal which is trans- ' . . A , . A , . v 

• . j r . , , ./ r . c . , , X-axis position control as indicated by X-axis servomotor 

mitted as generated by the aircraft transmitter 76 to the base 15 ^ r 3 

system receiver 14 and then converted at the base system by • 

format convenor 400 for processing or viewing at the base Y-axis position control as indicated by Y-axis servomotor 

station in its native format. Where desired, the convertor 54; 

may be at the sensor site as indicated in FIG. 2b. Of course, Lens zoom control as indicated by motorized zoom lens 

depending on the various systems being utilized, multiple 2 o 58; and 

conversion steps may be utilized. Format conversion capa- jns control as indicated by iris controller. (The iris may 

bility is required in order to make the system global in also be automated). 

nature. For example, the format of each aircraft is often As shown in FIG. 5, the camera system includes a base or 

dependent on the country of origin. The United States and mounting bracket 56 for mounting the system at location. 

Japan generally use an NTSC camera format. France and 25 The system body 52 is mounted on a tilt mount 54 (y-axis) 

Russia use SEC AM. The United Kingdom typically uses and pan mount 50 (x-axis), permitting panning (x direction) 

PAL. It is important that the ground or base station be able mi \ tilting (y direction) of the camera for scanning a wide 

to recognize and convert any of these formats to a suitable area> \ motorized zoom lens 58 is provided (z direction), 

format for processing by the base. Compatibility with The preferred embodiment of the system also includes an 

multiple, yet different, systems can be automatically accom- 30 audio sensor such as directional microphone 60. The audio 

plisbed. Instant protocol detection and conversion is shown sensor may be an acoustic transducer, such as a microphone, 

and described in my copending application, Ser. No. 08/816, ma t collects audio information from the surrounding area. 

399, filed on Mar. 14, 1997, entitled: "Instant Protocol The collected audio can be processed to detect potential 

Selection Scheme for Electronic Data Transmission via a emergency conditions such as a gunshot or an explosion, or 

Distributive Network". 35 can be routed directly back to the monitoring station. Using 

FIGS. 3a and 3b show a basic wireless digital system. As the sensors of the subject invention, locational origin of an 

shown in FIG. 3a, the transport 10 includes a sensor such as explosion or a gunshot or the like can be triangulated from 

the analog camera 29 producing an analog video signal multiple sensors and the positional origin can be calculated 

which is converted to a digital signal at convertor 510 and and displayed on maps as an overlay for assisting in pursuit 

compress at digital compressor 512 for transmission via the 40 of a perpetrator. The calculated origin can also be correlated 

wireless transmitter 76 via a digital wireless network 12. The by computer to the nearest appropriate emergency assets, 

Receiver 14 collects the signal, decompresses it at decom- base upon their known positions, and those assets may be 

pressor 520 for input to the base station monitor 18. The automatically dispatched. The audio analog/digital conver- 

system of FIG. 3b incorporates two-way communication tor adapts the acoustic signal representing the audio envi- 

with the basic digital system of FIG. 3a. In this embodiment 45 ronment into a digital data stream. The digitizer runs at 

the transmitter 76 is replaced with a digital transceiver 576 real-time rates for real-time audio monitoring. The audio 

in the transport and the base station receiver 14 is replaced signal processor/compressor has two functions. It is pro- 

with a digital transceiver 576. This permits command data grammed to perform detection in a number of different 

generated at the input device 501, such as, by way of manners. For example, the processor algorithms can be 

example, akeyboard or mouse orjoystick, to be encoded at 50 adjusted to detect impulse noises such as gunshot or a small 

encoder 502 and transmitted to the transport via transceivers explosion. Detection of such an event would trigger a 

514 and 576. The on-board control decoder 503 then trans- specified unique "alarm" for that condition to be transmitted 

mils the command or control signal to the device, such as, back to other elements of the system. Other types of detec- 

by way of example, tilt and pan control as indicated at 504 tion are also possible. By using frequency analysis trans- 

to camera 210. 55 forms and signature profiles, noises from engines, door 

FIGS. 4a and 4b are expansions of the system shown in openings or other distinctive noises could be detected when 

FIG. 36, adapted for use in connection with a ground-based warranted by the situation or condition. For audio surveil- 

wireless LAN 512 or a satellite based wireless LAN 612. In lance applications, the compressor can also be used to 

FIG. 4a, the on-board wireless LAN transceiver 576 is provide bandwidth reduction for audio transmission. In this 

connected to a hardwired on-board system such as the wired 60 application, the amount of data representing a real-time 

LAN network 590. Preferably, the on-board sensors would audio stream would be reduced by using audio compression 

be activated by the base unit on an "on-call" or a pro- techniques such as LPC-10, or other well-known or propri- 

grammed intermittent basis to conserve power. The various etary algorithms. This allows better bandwidth utilization of 

sensor systems such as camera 210 are connected via a LAN the wireless and wired communications channels used by the 

interface 582. The base station transceiver 514 is connected 65 system. 

to the base station LAN 530, through which the base station Illumination means such as the infrared illuminator 62 

workstation 18 and input devices 501 are connected. In the permits surveillance during low light no light conditions, 
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without detection by unauthorized personnel. A visual light/ to accept input from multiple sensors and process the inputs 

strobe light 63 can be turned on by locally detected events, in a "fused" manner. For example, signals form an infrared 

by control signal, or by other system elements such as detector and ultrasonic detector may be "added" together, 

detection by a companion sensor unit signaling over the then threshold detection performed. This ensures that both 

LAN. This light can illuminate an area of concern, attract 5 an optical and an acoustic return are detected before an 

attention of security personnel as a signal, or scare away alarm condition is broadcast. These and other more sophis- 

unauthorized personnel or intruders. ticated well known techniques can be used together to gain 

An integrated GPS receiver 64 is provided for generating better sensitivity and/or improved detection accuracy, 

location information. This is particularly useful for "drop- Detection of such an even would trigger a specified, unique 

and-place" sensors as opposed to permanent sensors. Other 10 alarm condition to be transmitted back to the other elements 

features such as a laser range finder 66 that can measure of the system. 

distance to objects/personnel may be incorporated to further Typically, the sensors will "sense" the presence of unau- 
expand and enhance the capability of each sensor compo- thorized activity and activate recording from the various 
nent. The camera system shown has full 360 degree field of audio and/or video equipment and activate alarms. This will 
view capability which may be controlled manually by 15 initiate the generation of a signal at each of the activated 
remote control signals, may be programmed to pan the area units. The generated signals will then be transmitted to the 
on a time sequence, may track a moving transport using GPS monitoring and recording equipment, as described, to permit 
signals from the transport or by using image processing both real-time surveillance and recordation of activity at the 
"tracking software" processing the camera image, or may be site. Motion detection may also be determined using video 
responsive to and activated by an event occurrence such as 20 time/change techniques in the well-known manner, 
from sensors distributed throughout the ramp areas, report- FIG. 6 is an expansion and further refinement of the 
ing activity over the LAN, in the well known manner. The system of FIG. 1 and is a diagrammatic illustration of the 
range finder 66 permits the tracking system to locate objects system of the subject invention as configured for a wireless 
in a precise manner and then provide control signals to local area network (LAN). In the preferred embodiment the 
permit accurate surveillance and monitoring of same, such 25 aircraft 10 will include a comprehensive in-flight security 
as zooming the camera or positioning of other sensor system, as better shown in FIG. 7, which is cutaway diagram 
elements. An onboard dual GPS systems on the aircraft, with of a typical commercial airline fuselage 10, with the cargo 
one GPS at the tail and one at the nose, used in conjunction hold 12, the passenger cabins 15, 16 and the flight deck or 
with the GPS system 64 permits the system to determine cockpit 21 partially visible and a plurality of sensors 19o-n. 
size, heading and distance to the aircraft being monitored, 30 A more detailed description of this onboard system is shown 
providing accurate location information and permitting the and described in my aforementioned U.S. Pat. No. 5,798,458 
camera to automatically adjust to monitor the entire aircraft and copending applications Ser. No. :08/729,139, and 
within its range. This permits the selection of the correct 08/745,536. In the subject invention, the currently available 
camera when multiple cameras are available and permits a sensors may be utilized, without additional enhancements or 
wide range of viewing possibilities by being able to deter- 35 a number of additional sensors may be added. For example, 
mine what portion, if not all, of the aircraft is to be ground surveillance could be accomplished using only the 
monitored at any given time. In those instances where the on-board sensors on the aircraft. In the example, a number 
aircraft is equipped with a single GPS system, much of this of video image sensor devices such as, by way of example, 
versatility is preserved. However, it will be understood that analog video cameras; may be mounted inside the skin of the 
aircraft size then would have to be determined from the 40 aircraft and aimed through openings or windows provided in 
aircraft type or by optical means. When the transport is not the fuselage to focus on critical components of the aircraft, 
equipped with the GPS system, the other sensors such as the such as the landing gear cameras 20, 22, the wing engine 
range finder/tracking camera or ground level sensors would camera 24 and the tail camera 26. Similar devices or 
provide data for cameral selection and updating of electronic cameras may also be strategically placed throughout the 
situational maps. Each sensor and/or camera may incorpo- 45 interior of the aircraft, such as the passenger cabin cameras 
rate a motion sensor and/or an audio sensor activation device 28, 30, 32, 34, 36, 38, 40, the cargo bay cameras 42, 44, 50 
so that the system may be activated when a sound or a and 52, and the flight deck camera 46. The sensors 19a-n 
motion occurs within the sensor range. The motion detector may include smoke and fire detectors, motion detectors and 
may comprise any transducer unit that can detect the pres- audio sensors strategically placed throughout the aircraft, 
ence of an intruder and can be a device such as an infrared 50 both internal and external of the fuselage. The placement 
motion detector, a thermal sensor, an ultrasonic detector, a and number of devices is a matter of choice depending upon 
microwave detector, or any hybrid of two or more of these the configuration of the aircraft and the level of surveillance 
detectors "fused" together to gain better sensitivity and/or desired. In the preferred embodiment the on-board aircraft 
improved detection accuracy. A motion detector convenor sensor system is used in combination with the ground based 
may be incorporated to convert the signal from either a 55 system to provide a comprehensive surveillance and security 
single motion detector sensor or a battery of sensors to system of the aircraft while on the ground, 
digital form for processing and/or transmission to other With specific reference to FIG. 6, in the preferred embodi- 
system elements. Multiple elements may be contained ment the aircraft 10 will also include a nose GPS sensor 200 
within a single sensor system package, or may be fused for and a tail GPS sensor 202. The dual GPS sensors permit 
multiple sensors in geographically distributed elements with 60 redundancy, very accurate location and directional position- 
data to be fused being transmitted over the LAN. The motion ing of the grounded aircraft, as well as providing informa- 
detector signal processor is adapted for analyzing the sensor tion identifying the size of aircraft An aircraft reference 
data streams from one or more sensors to provide for better signal (such as tail number) country of origin, owner, and the 
sensitivity or improved detection accuracy. Well-known like, may be incorporated in the transmitted signal so that the 
techniques may be implemented to process the transducer 65 monitoring station can identify the aircraft, its location and 
data and detect surges over the set thresholds that represent the security condition thereof by monitoring the signal from 
detection. The processor/compressor can also be configured that specific aircraft. In the wireless embodiment shown, the 
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aircraft is equipped with a wireless transceiver 204 for vicinity. This would also allow the automatic signaling and 

transmitting all of the collected signals from the sensors and dispatch of personnel based upon their identity or based 

cameras via the wireless network represented by the wireless upon their GPS determined location, 

communication "cloud" 206. The wireless system shown in The system wireless LAN transceiver 212 operates as the 

FIG. 6 permits transmission not only to the ground control 5 gateway to the ground based, permanent, wired facilities. A 

tower and security, but expands the transmission of data to router 228 is provided to bridge the various airport facilities 

all locations and stations which are part of the wireless (i.e. an intranet). The router is a typical industry type, as is 

system. For example, the signals may be transmitted to a well known to those skilled in the art, and may be installed 

patrolling ground security vehicle 208, a portable monitor- in many configurations as required. Where desired, the 

ing station 218 and/or to the ground security center via the 10 system may be connected to remote nodes as well, through 

wireless LAN transceiver 212. In addition, signals may be a wide area network (WAN), permitting connection to FAA 

transmitted in either a send or receive mode from any unit regional centers, airline corporate operations or aircraft 

in the wireless system to any other unit therein. This is manufacturer operations, for example. The router may be 

particularly useful when trying to coordinate a response to configured as needed with typical commercial techniques, 

an incident in a quick response mode. 15 such as firewalls to protect access, protocol convertors, and 

As shown in FIG. 6, permanent ground units may be encryption devices, as needed to direct secure or unsecured 

hardwired in typical wired LAN system configuration, with information to the various ports, nodes and centers, 

a single wireless LAN transceiver 212 serving the perma- Where desired, only pre -selected alarm signals may be 

nent ground base portion of the system. Depending on transmitted to selected centers. For example, any heat or 

convenience of application, it will be readily understood that 20 smoke detection, fuel spill detection or medical emergency 

any combination of wired or wireless component configu- would generate an alarm signal at the fire control center 226. 

rations can be utilized. For example, it the maintenance The maintenance hangar may have access to fluid sensor 

hangar 214 were a great distance from the ground surveil- data and stored maintenance requests and records. Thus the 

lance center at tower 216 a wireless (RF or optical) LAN system can be configured in an information hierarchy format 

communication link may be preferred over a hard-wired 25 where only useful information is forwarded to the various 

system. Use of the wireless LAN will also greatly facilitate centers. 

the adaptation and retrofitting of airports not having ready The use of the dual GPS receivers 200, 202 on the aircraft 

cabling capability or infrastructure. 10 permits the reporting of the general location of the 

The wireless LAN 206 or other wireless communication aircraft on the ramp during taxi when parked whether or not 

system provides a connection between the aircraft 10, the 30 attended. The use of two GPS receivers provides 

fixed ground resources via transceiver 212, mobile ground redundancy, better accuracy and orientation information for 

resources such as the security vehicle 208, portable ground the aircraft by reporting two distinct position datum signals, 

resources such as the portable ground security station 218 It will be readily understood by those skilled in the art that 

and various functional or operation centers such as the other position signal devices could be utilized such as, by 

control tower 216, the operations control center 220, the 35 way of example, a single GPS receiver and a magnetic 

security center 222, the maintenance center 224, the main- compass (which may have to be corrected for local magnetic 

tenance hangar 214 and the airport fire station 226. fields or interference). By linking the position and orienta- 

In the preferred embodiment, and as shown in FIG. 6, the tion information to the ground based centers the location and 
portable (or drop in place) camera/sensor/link device 210 orientation of the aircraft at all times it is on the ground the 
(see FIG. 5 and accompanying description) is adapted for 40 aircraft may be closely monitored. Such a system provides 
providing any combination of video surveillance, audio ground control transmitting signals showing the location and 
surveillance, motion detection, acoustic detection, sensor movement of all aircraft while on the ground, in much the 
positioning capability and wireless link to other system same manner the radar transponders provide air controllers 
elements. The security vehicle 208 is equipped with a sensor with position and movement data while the aircraft is 
viewing capability as well as an alarm annunciator to alert 45 airborne. This is particularly desirable when the movement 
the operation for quick response. Typically, the transmission of aircraft is portrayed on a map display. Other ground 
of an alarm signal by the aircraft will trigger a linkup at the vehicles such as fuel trucks, waste water trucks, baggage 
various monitoring units and will interrupt routinely moni- handling trains, security vehicles and the like can also be 
tored signals. The alarm signal will include aircraft identi- tagged with GPS receivers and LAN transceivers for moni- 
fication and location data, as well as an indicator of the 50 toring their position relative to the aircraft on the ramp. An 
sensor triggering the initiation of the alarm signal. The alarm automated computer system can be operating in the back- 
location may also be displayed on a "moving map" display, ground looking for potential collisions and generating alarm 
in the well know manner. This permits a quick response team messages if such a conditions is detected. Another auto- 
to focus on the incident causing the generation of the alarm mated computer function can track vehicles relating to their 
signal. In the preferred embodiment of the invention, the 55 authorized areas and issue alarms if security is breached. Yet 
alarm at the sensor location is adapted to operate in either an another function can track the presence or absence of needed 
audible or silent mode, depending on the surveillance opera- services, such as the timely appearance of catering trucks, 
tion. For example, a warning signal may be broadcast at the fuel trucks, wastewater trucks, baggage trains and the like 
location to scare off intruders who breach a restricted area or, after the arrival of a subject transport. If any of these 
in the alternative, the warning signal may only be transmit- 60 required services do not arrive at the transport within a 
led and sounded at the base station and/or security vehicles prescribed time period, and "alarm" can be reported over the 
alerting base personnel of a situational change at the moni- LAN to the missing services vehicle, and/or to the respon- 
tored zone. Hand held or belt mounted wireless LAN sible operations center. This function can be completely 
personal security assistants can also be used. These would automated by a controlling computer system, 
allow personnel to have access to critical security informa- 65 As shown in FIG. 8, in a typical installation, external 
tion while on foot patrol or making rounds, permitting sensors 210a-g placed on the ramp in the vicinity of the 
almost immediate response to activating conditions in their aircraft to monitor the exterior of the aircraft. For example, 
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a plurality of video cameras 210a and 210/? may be placed receive between the fixed sensor station(s) 20 as indicated 

along the exterior fence 300 of an airport. In additions, by wireless data path C. The fixed sensor station is also in 

cameras may be placed in other strategic locations such as direct communication with the ground station as indicated 

the camera 210c mounted on the terminal building 310 and by wireless data path D. It should be understood that 

the remote cameras 2i0d-n mounted on base units 312 5 permanent installations such as the ground station and the 

located strategically throughout the airport. When an aircraft fixed sensor station could be hardwired with one another 

10 is parked on a surveyed area of the airport ramp 314, the without departing from the scope and spirit of the invention, 

various cameras 210a-fi and or other ground based sensors In addition, support vehicles such as, by way of example, the 

will provide a secure area for the aircraft. Any activity baggage train 13 may be equipped with sensors such as 

within the range of the cameras may be viewed and moni- 10 location sensors and the data generated by this sensor may 

tored. be transmitted to the ground station via path B, the monitor 

The system of the subject invention is designed such that station via path E and directly to the transport via path E The 

aircraft onboard sensors and ground-based sensors may be ground station 18, monitor station 20 and transport 10 may 

used in combination to provide a comprehensive security also communicate directly with the ground support vehicle 

system. The ground-based sensors may be used alone to 15 13. For example, if the ground support vehicle comes within 

provide basic ground security. The aircraft sensors may be a designated "keep-out" or no trespassing zone or is too 

used alone to provide some ground based security with a close to the transport, a proximity sensor or calculated from 

minimum of modification to existing hardware. the GPS data,may be utilized to activate and send a warning 

In the embodiments shown and described, a multi-media signal to the ground support vehicle. As indicated by wire- 
recorder is utilized to record the information for archival 20 less path G, sensor data may also be communicated between 
purposes. This can be a ground based recorder or the aircraft multiple transports 10 and 10c. 

"black box" recorder 58 (shown as installed in the tail The comprehensive system of the subject invention not 

section of the aircraft, see FIG. 7) may be utilized, in the only provides surveillance of the aircraft while at the gate or 

same manner as the current data and voice black boxes (not while unattended, but also provides taxi protection and 

shown). 25 monitoring. As shown in FIG. 11, when all ground vehicles 

Audio and video monitors are also provided at the base such as fuel truck 11 and baggage train 13 are outfitted with 

security station to provide near realtime surveillance. The GPS receivers as well as the aircraft 10, the location and safe 

flight deck monitor and control panel 54 is located on the distance of each vehicle and the aircraft may be monitored, 

control panel in the cockpit 21 will also have access to this "Train" type vehicles may be outfitted with two or more 

information. Other monitors may be provided where desired. 30 GPS receivers to relay the length of the vehicle. Each car can 

Turning now to FIG. 9, the system shown is adapted for have a separate module. A computerized map of the airport 

wireless installation using both onboard aircraft sensors and tarmac T, the taxiways P and runway R can be generated 

ground based remote sensors. The system shown relies on showing the position, direction and movement of each 

the standard on-board radio of aircraft 10 to transfer all vehicle and the aircraft. Predefined keep-out" zones "Z" may 

aircraft signals to the base station receiver 81 via antenna 35 be established and an alarm may be sounded if the zones are 

81a. In the alternative embodiment of FIG. 9, the ground- breached. Also, prescribed areas for authorized vehicles may 

based cameras (camera 2\0d) and a motion sensor 31 are be established and monitored. If a vehicle is outside the 

hardwired as shown at 87 to a controller 85. The on-board designated area, or breaches a zone "Z", an alarm condition 

signals are input from the receiver via hard wire 89. Wireless will result. This can be prioritized as a cautionary breach, a 

ground based sensors such as the camera 210a and the 40 dangerous breach and so on, depending on proximity of the 

motion detector 31a may be used in combination with the various vehicles and aircraft to one another. For example, if 

hardwired ground based cameras (see camera 210*/) or other an aircraft 10 comes too close to a fuel truck 11, alarms in 

hardwired sensors. This permits maximum flexibility of the the aircraft, the fuel truck will be activated. In the situation 

system architecture. The wireless signals will be transmitted advances to a danger zone, a second alarm condition may 

via a dedicated sensor array transmitter/receiver 83 and 45 alert ground or base personnel that a breach has occurred so 

antenna 83a. the intervention may be initialized. Logging of the "safety" 

The controller 85 will feed the data signal to a split screen breaches can be made so that safety improvements or 

monitor 93, where all video signals may be simultaneously training may be implemented based on need, 

monitored and/or to a plurality of distinct monitors 91a-91/z. A combination of ground sensors in a matrix on the airport 

The split screen technology and methodology is more fully 50 ramp (see sensors 210a-210« in FIG. 8) will scan and 

described in my copending application entitled: monitor vehicles. If a vehicle is detected that does not have 

(PhotoTelesis 006), incorporated herein be reference. It will a GPS identification authorized for that location and alarm 

be readily understood that as many monitors and audio condition will result. For example, if a stray baggage train 13 

output devices as desired may be utilized, permitting sur- entered the taxiway area, an alarm would sound indicating 

veillance at various locations throughout the port. In the 55 that the train 13 has entered an unauthorized area. Emer- 

preferred embodiment all of the signals are stored in a gency and security personnel may also be alerted and 

recording system as indicated by the mass storage unit 95. dispatched if unauthorized or untagged (no GPS identifier) 

This permits replay of the transmitted signals for reconstruc- vehicles are present. This protection scheme could be 

lion of events and also provides permanent archive records expanded to include personnel as well as vehicles. For 

where desired. 60 example, the ground vehicle can have a sensor that reads a 

As shown in FIG. 10, the use of a wireless network personnel security token or device such as an encoded 

provides maximum versatility in the transmission of infor- digital key. This key information would enable the vehicle 

mation and the monitoring and processing capability pro- and would also be encoded with GPS information and 

vided by the system. As indicated in FIG. 10, the transport vehicle identification, which is transmitted over the LAN. 

10 both sends and receives information between the ground 65 Security software can then check to determine if the indi- 

station 18, as previously described and as indicated by the vidual is authorized to be present in the vehicle at that time 

wireless data path A. The transport may also transmit and and location, activating an alarm if proper authorization is 
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not confirmed. The vehicle could also be immediately shut Each sensor device signal is introduced into a multi-media 

down. Visual identification of personnel may also be accom- multiplexer network 232 which includes a image multi- 

plished using the sensor systems of the subject invention. plexer subsystem 234, a dedicated audio multiplexer sub- 

FIGS. 12a, 126 and 12c show alternative embodiments system 236 and a digital data multiplexer subsystem 238, all 

permitting use of a wired or wireless LAN transmission 5 of which produce distinctive multiplexed signals which are 

system. As shown in FIG. 12a, with a camera sensor CI for introduced into a master multiplexer subsystem 232 for 

purposes of simplification, the camera CI generates an producing a combined, comprehensive output signal as 

analog signal which is converted to a digital signal at selected on each of lines 231, 233 and 235. It may also 

converter 400 and then compressed at the motion video P crforra decompression functions for compressed command 

am TL- u r u a u a . streams and compressed audio or video. The setup and 

compressor 402. ITus can be accomplished by industry 10 of ^ com F hensive om t si , fe providedbya 

standard techniques such as motion-JPEG, MPEG, or master 241 and m ut to ^ multiplexer 232 at 
motion wavelet compression or other current or future 243. The system controller receives commands and stream- 
compression algorithms. The compressed digital signal is mg audio inf on nation from other system elements and 
then packetized by the LAN interface 404 and transmuted to distributes them to controlled devices. The controller per- 
the LAN 206 in well-known manner. An analog audio sensor 15 forms a command decoding function to sort out command 
such as microphone 19 is added in FIG. 12b and is supported and da t a streams directed toward specific devices and com- 
the dedicated convenor 406 and compressor 408 for input to ponents of the system. 

the multiplexer 410 where the compressed digital audio The visual and textual data is available at a display 

signal is combined with the compressed digital video signal monitor 54. The audio signal is output at 237 to an audio 

to produce a complex multi-media signal for packetization 20 output system such as amplified speaker 240. All of the data, 

by the LAN 404 interface. As shown in FIG. 12c, digital including all video, audio and digital data will be recorded 

sensors such as motion detector 31 may also be included. on the recorder system 70. Information representing audio, 

The motion detector digital signal does not require conver- video, sensor data, and other vital digital data is fed from the 

sion and is input directly into the multiplexer 410. As also multimedia multiplexer to the recorder 70 over the signal 

shown in FIG. 12c, the LAN may be wireless, with a 25 lines 233. It should be noted that the multimedia multiplexer 

wireless transceiver 412 being incorporated in the system. may be analog, digital, or packetized digital data type, or a 

As previously described, any portion of the system may be combination of technologies based on application. Where 

wired or wireless depending on ease of installation, mobility desired, selected portions of the systems data on the aircraft 

requirements and other issues. It may be noted that functions may be down-linked to the ground or base station 18 (see 

such as the motion video compressor, audio compressor, 30 FIG. 2) as the combined, comprehensive output signal on 

multiplexer and LAN protocol functions may all be per- line 246 to be transmitted to the ground station via the 

formed as software and could operate on one high speed aircraft radio system 80 and the antenna 82. As previously 

computer such as a Digital Signal Processor (DSP). described, the information may also be transmitted to a 

Turning now to FIG. 13, additional multi-media sensors wireless satellite via transceiver 280 and dedicated antenna 
may be incorporated in the system, as well, and may be 35 282. Once the information is generated as a useable data 
wireless or hard wired as appropriate. For example, one or signal, as indicated at line 231, 233 and 235, the controller, 
more audio sensors such as a cockpit voice sensor 113 in combination with commands from ground security, con- 
transmit audio signals to multiplexer processor 232. Various trols the collection, monitoring and review of the informa- 
function sensors, such as, by way of example, an entire array tion. This permits access to any single sensor signal, or any 
of intrusion security sensors 115 may also be incorporated in 40 combination via line 231 by sending a command via line 248 
the multi-media system of the subject invention. Where a to the controller 241 for controlling the monitor related 
plurality of such sensors are utilized, it is desirable to multiplexing switches via line 243 to control the signal 
provide a local multiplexer system 238 to minimize the output on line 231. For example, this may be a single camera 
amount of duplicative hardware. In the example shown, all view or an array of intrusive motion sensors 115. 
of the intrusive security sensors in array 115 require only a 45 Where desired, a light level detector may be is used for 
single transmitter and antenna as part of a local multiplexer detecting light conditions such as the ambient lighting or 
238 which may then feed a combined signal to the multi- transient conditions such as vehicle headlights or a flash- 
media multiplexer 232. In a wireless system, the security light. The light detector analog/digital convenor adapts the 
sensor array may also be fully self-contained with an inde- ambient light levels into a digital data stream, this digitizer 
pendent power supply. 50 runs at rear-time rates for teal-time illumination monitoring. 

As shown, a variety of image sensor devices may be The light detector signal processor can be programmed to 

incorporated, including the video cameras CI, C2, C3 . . . look for profiles such as rapidly increasing light conditions 

Cn, an advanced imaging device such as the FLIR camera that may indicate a vehicle or a flashlight as opposed to the 

220, the on board radar 222 and the like. All of these produce rising or setting sun. Detection of such and event would 

a visual signal. In addition, various audio signals may be 55 trigger a specified unique alarm condition to be transmitted 

incorporated utilizing a variety of audio sensor devices, such back to other elements of the system, 

as a cockpit voice sensor 113, on board radios 224, 226 and External contact sensors may also be deployed and a 

the aircraft public address system 228. All of these produce condition change may be detected and processed by the 

an audio signal. The operational data signals are also contact signal processor. These may be devices such as door 

incorporated, as previously described, and may include the 60 contacts, special motion detectors such as trip wires and the 

GPS sensor 72, other navigational sensors 230, the various like, floor pads and the like which can be connected, either 

intrusion sensors 115 and other sensors 125. Thus, the by wires or wireless means to the contact detection circuit, 

system of the subject invention will accommodate a multiple Detection of such an event would trigger a specified alarm 

input, multi-media array incorporating video, audio and condition to be transmitted back to other elements of the 

digital data signals into a comprehensive database for pro- 65 system. 

viding detailed information relating to the aircraft condition An audible speaker system can also be provided in the 

at any time. preferred embodiment and can provide numerous audio 
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outputs such as, by way of example, voice output or a siren. FIG. 16 is an expanded illustration demonstrating the 

This is a multi-function device and can be activated by local calculation and signaling of appropriate personnel and 

detection events, and by other system elements such as equipment to the site of an event requiring emergency 

detection by a companion sensor unit signaling over the response. By way of example, assume the tracking camera 

wireless system. The siren can indicate an area of concern, 5 210a and 210b provided a visual signal indicating smoke at 

serve as a signal to security personnel and/or scare of transport 10. At the same time, the on-board fire and smoke 

intruders. The audible speaker can also be used to provide detectois would transmit a signal to the ground based 

voice instructions or signals base on local detection events, transceiver 212 via the wireless LAN- In addition, the 

and by other system elements. The controller produces the P«"» ocaU c 0D 0 ** tra f ™» ^Tr P Z 

.u • j . i m_ .11 the location signal generated by the transport GrS sensor 

synthesized or stored voice signals. The controller can 2 00 which is aL trLmitted over the J^. The receipt of 

programmed or downloaded over the wireless system. The ^ vark)us ^ j ^ actiyate actioQS F a „ of 

speaker system can also be use as a paging system by ^ informatio * ^ be ^ismM* t0 lhe ground conlrol 

sending digitized or compressed voice signals over the lQwer 2U ^ {Q ^ tions ^ 2 20, as has 

wireless system to one or more multi-media devices. In beeQ iousl descri5 £j herein . ^ ai n fire sla(ion 226 

addition, the audio speaker can be use conjunction with the ^ £ alcrted ( Q ^ indication of a firc J d smoke evcnt and 

audio detector 408 lie ) communicate wath the area. 15 the security center 222 and maintenance center 224 will 

Power is provided in the well-known manner. In *e iye J mformalioD . ^ automate d dispatch 

pre erred embodiment, system power is used to power up the te /£ m P er 225 ^ monitor me locatioD signa f pro . 

system through a convenor and a rechargeable battery £ » P 

system compnsing a charger/controller and rechargeable 7 , ivi T , . tf" « AO 

battery supply ground personnel 218a-218c, response vehicles 208a-208c 

In certain applications it may be desirable to combine 2 ° fir< ; ^support vehicles 352fl-c By monitoring the type of 
many of the functions described herein, such as the signal event that has occurred and both the type and location of 
processing, data multiplexing 232, D\N or WAN network available personnel and equipment, the dispatch center can 
transceiver 330, control and parts of the network interface, alert and initiate the most efficient appropriate response. The 
perhaps utilizing software running at high speed in a high location signals provide sufficient information for the corn- 
speed DSP engine. This would serve to reduce hardware 25 puter system 225 to determine by wellknown methods, 
complexity, improve reliability, reduce power consumption, which asset is closest. For example, ground personnel 2186 
and reduce cost. The network interface provides a wired is closest and would receive the first response signal. If a 
interface to the system for connecting other system elements response vehicle was programmed to respond, vehicle 208a 
in a hardwired configuration. This can be any one of several would be first alerted. Likewise, the closest fire truck is truck 
well known but evolving technologies such as lOBase-T, the 30 352c, which would be the first alerted. As back-up is needed, 
better 100 Base-T or high-speed Gigabit LAN or WAN each of the ground support assets have the capability of 
technology. Such a configuration does not depart from the signaling for additional support directly back to the dispatch 
scope and spirit of the subject invention. computer. The computer can then select the next closest 

FIG. 14 is a diagrammatic illustration of an integrated appropriate asset. The system of the present invention pro- 
sensor/wireless LAN subsystem using DSP technology. As 35 vides a comprehensive, efficient method of collecting, dis- 
there shown, the various analog sensors such the light sensor tributing and reacting to critical information to maximize the 
300, the temperature sensor 302, the humidity sensor 304, response of appropriate functional vehicles and personnel on 
and the sound or audio sensor 306 (as well as other sensors a real time basis while assuring that assignments are priori- 
as previously described herein and as desired for applica- tized as set by operational personnel. This greatly increases 
tion) produce analog signals which are converted at one of both the timing and the effectiveness of response to critical 
the dedicated analog-to-digital converters 310 and then 40 events. 

introduced into a multiplexer 312. The multiplexer 312 The multi-media security and surveillance system of the 
produces a combined digital output signal which is intro- subject invention provides an enhanced security scheme 
duced into the DSP processor 314, which produces the giving instantaneous and live image access to critical corn- 
system output on line 315, where it is again converted at ponents and areas of an aircraft or vehicle, providing the 
convertor 316, amplified at amplifier 3 18 and transmitted via 4 $ ground based security personnel with additional information 
antenna 320. In the preferred embodiment, an integral power while the aircraft or vehicle is not in use and is left 
supply 322 is provided. The Sensor I/D address is on line unattended. In addition, the permanent tape record will 
324. This system provides a highly integrated sensor/pro- prove invaluable for investigating unauthorized activity or 
cessor/transceiver and typically can be housed on a single accidents after they have occurred. The preferred embodi- 
chip using available configuration technology. 50 rnent of the system is specifically designed for new com- 
FIG. 15 is a diagrammatic illustration of the placement of mercial aircraft but is equally well suited for retrofit appli- 
tracking sensors on the ramp and laxiways of an airport for cations and for other safety applications as well, and may be 
tracking the movement of the commercial transports such as scaled up or scaled down depending on application, 
transports 10a and 106 as they come into the gate area 350. The video recorders, synchronizing networks and multi- 
The sensors S1^S32, are strategically place to track the 55 plexing and split screen hardware are well known and their 
transport as it proceeds along the runway, the taxiway and adaptation will be readily apparent to those of ordinary skill 
the ramp. This is particularly useful for aircraft which do not in the art. Any suitable video recording format can be used, 
have GPS signal generating sensors, making it possible to for example, an analog video tape recorder, a digitizer and 
track and identify the transport at any time. Various sensing tape, hard drive or optical drive configuration. Digital cam- 
devices can be utilized in this configuration such as acoustic eras could be incorporated in lieu of the standard analog type 
sensors, acoustic return "sonar", optical, optical return, 60 cameras currently in use in most applications. As digital 
microwave, microwave return, contact or weight detection, technology becomes more readily available and more cost 
electronic proximity (underground wire), or similar sensors. effective, it is contemplated that most of the imaging, 
The sensor system detects the transport, and where return monitoring and-recording equipment will be of a digital 
sensors are used, will also identify the distance. By using format because of the increased reliability and the mini- 
sequential sensors, the speed and direction of travel may also 65 mized space requirements. Of course, it should also be 
be calculated. This type of sensor system will also detect the understood that the monitoring, transmitting and storage 
presence of other assets or personnel in the area. capabilities of the invention are also well suited for captur- 
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ing any video or visual image generated by the on board 10. The system of claim 1, wherein at least one of the 

avionics of the aircraft. ground based sensors further includes a transmitter associ- 

While certain features and embodiments of the invention ated with the sensor and there is further included a receiver 

have been described in detail herein, it will be readily associated with the ground based monitoring station, 

understood that the invention encompasses all modifications 5 whereby the unique data signal generated by said sensor is 

and enhancements within the scope and spirit of the follow- communicated over a wireless communication system from 

ing claims. the sensor to the ground based station. 

What is claimed is: 11. The system of claim 3, wherein one of said sensors is 

1. A security and surveillance system for ground or in port an image sensor, and one of said sensors is an audio sensor 
monitoring the condition of and tracking the location of a for providing a visual and an audio data definition of the 
commercial transport as it moves about in monitored zones, 10 conditions in the proximity of the commercial transport 
the system comprising: 12. The system of claim 11, wherein one of said image 

a. a ground based monitoring station for monitoring the signal, said audio signal and said data signal is an analog 
position of and conditions relative to a commercial signal and wherein one of said image signal, said audio 
transport when in port- signal and said data signal is a digital signal, the multiplexer 

b. a network of ground based sensors positioned on the 15 network further including an analog to digital converter for 
ground and throughout an area to be monitored for converting .the analog signal into a converted digital signal, 
defining a plurality of operating zones within the area, *he multiplexer adapted for multiplexing the converted digi- 
each of said sensors operational within the thus defined tal sl S nal and the dl » lal Sl &>* 1 ml ° a combined digital 
operating zone and adapted for monitoring a pre- output signal 

selected condition associated with the commercial ™> ^ W*™ of claim L wherein at least one of said 

transport while within the operating zone for generating 20 sensors comprises an image sensor device for generating an 

a unique data signal representing the specific condition image signal. 

to be monitored for describing both the status of the M. The system of claim 8, further including an i ttumi- 

pre-selected condition of the commercial transport and nation source associated with said image sensor for illumi- 

for identifying the commercial transport as being nating the critical location. . , . , 

located within the zone: « 15 - ^ of claim 8 > wherein said image sensor is 

c a communication system for ,a„sm,«ing ,he unique » ^^X^^SS^^am^ 

data signal from each of the network of ground based 4B '! UC U1 . , *' 1 . r 

sensors to the ground based monitoring station for an aud J° .^r generating an audio signal, 

monitoring the selected conditions at the commercial 17. The system of claim 1, wherein said sensor comprises 

transport, whereby both the condition and the location an sensor device for generating an image signal and 

of the commercial transport may be determined; and 30 at least one audio sensor device for generating an audio 

d. the ground based monitoring station further including signal. . . . 

a processor whereby all of the data signals from the ™ ™ e s Y stem of claim l > whereiD said ^ nsor comprises 

network sensors is combined in order to derive the a motion detector device for generating a signal whenever 

comprehensive condition of the commercial transport motion is detected in the range of the device, 

based on the data from all of the sensors. 35 19. The system of claim 1, wherein said sensor comprises 

2. The system of claim 1, the processor further compris- an intrusive sensor device for generating a signal whenever 
ing: intrusive activity occurs in the monitored area of the device. 

a. a collector adapted for collecting the plurality of data 20. The system of claim 1, wherein said sensor comprises 
signals from the plurality of sensors and generating a fire detection device for generating a signal in the event of 
therefrom a combined signal incorporating each of the a fire. 

plurality of signals into a combined output signal; and 40 21. The system of claim 1, wherein said sensor comprises 

b. a processing system for receiving and processing the a smoke detection device for generating a signal in the event 
combined output signal. of the presence of smoke in the range of the device. 

3. The system of claim 2, wherein said collector com- 22. The system of claim 1, wherein said transport has an 
prises a multiplexer for accepting all of the plurality of data on-board monitoring system including a network of 
signals and for generating therefrom a combined multiplex 45 on-board sensors adapted for monitoring specific on-board 
signal preserving the discrete identity of each of the plurality conditions and generating a data signal in response thereto, 
of data signals. and wherein said ground based monitoring station and said 

4. The system of claim 3, wherein said combined multi- network of ground based sensors are adapted to interface 
plex signal includes specific, time sequenced interval seg- with said on-board monitoring system to provide compre- 
ments of the plurality of data signals in a serial format. 50 hensive information to both the ground based monitoring 

5. The system of claim 4, wherein said combined multi- station and the on-board monitoring system inclusive all of 
plex signal includes the plurality of signals released simul- the data collected by both the on-board sensors and the 
taneously in a compressed, parallel format. ground based sensors. 

6. The system of claim 2, said collector and processing 23. The system of claim 17, wherein said on-board sensor 
system further including a self-contained power supply. 55 is a global positioning sensor adapted for generating a signal 

7. The system of claim 2, the collector further includes a indicating the location of the transport. 

multiplexing system adapted for accepting a plurality of 24. The system of claim 18, wherein said global position- 
parallel data signals simultaneously and for generating ing sensor includes a separate sensor component in each end 
therefrom a single, combination output signal. of the transport, whereby size and heading of the transport 

8. The system of claim 7, wherein said multiplexing may be monitored. 

system is adapted for generating a combination output signal 60 25. The system of claim 16, the collector further com- 

including a component comprising a plurality of the data prising a multiplexer network for combining an image 

signals in a split screen configuration wherein all or a signal, an audio signal and a data signal into said combined 

selected portion of the plurality of data signals are simulta- output signaL 

neously available. 26. The system of claim 1, further including a recorder for 

9. The system of claim 1, wherein at least one of the 65 capturing the combined output signal in a retrievable format, 
ground based sensors is hard-wired directly to the ground 27. The system of claim 25, wherein said recorder corn- 
based monitoring station. prises an analog recorder. 
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28. The system of claim 25, where m said recorder com- 48. The system of claim 2, wherein there is further 
prises a digital recorder. provided support systems in port for supporting the com- 

29. The system of claim 25, wherein said recorder is mercial transport and wherein said support systems further 
multi-channel. include at least one support system sensor adapted for 

30. The system of claim 24, wherein said combined output 5 transmitting a signal to the ground based monitoring station, 
is in a serial format. whereby conditions of the commercial transport and the 

31. The system of claim 24, wherein said combined output support system may be simultaneously monitored. 

is in a parallel format. 49. The system of claim 47, wherein said sensor and said 

32. The system of claim 30, wherein said parallel format m SCQSOr arc cach lobal system 
k adapted for split screen viewing of a plurality of video M scnson _ whcreby ^ nMye proximity of thc ^ercial 

S1 SJ. The system of claim 3, wherein each sensor further lraD *P° rt ^ lhc su PP ort s ^ cm m ^ bc trackcd and mom ' 

includes a transmitter adapted for wireless transmission of or * ^ e t . AO . . . . ,. . 

the combined output signal to a remote location and wherein 50 - ™* ****** of claim 48 further including an alarm 

said ground based monitoring station includes a receiver, 8 CDcrator for generating an alarm whenever the support 

whereby the sensor signal may be transmitted to the moni- 15 system is in a excluded region occupied by the commercial 

toring station. transport. 

34. The system of claim 1, further including a mobile 51. The system of claim 49, wherein the ground based 
monitoring station for receiving the unique signal from the monitoring station further includes a mapping capability for 
sensor. generating a map defining the presence of the commercial 

35. The system of claim 1, wherein there is further 20 transport relative to the support system. 

included ground support equipment and ground support 52. The system of claim 50, wherein said support system 

vehicles, and wherein each of said ground support equip- sensor includes a support system identifier for signaling to 

ment and ground vehicles includes location sensors for the ground based monitoring station the identity of the 

generating and sending ground support location signals, support system. 

whereby the position of the commercial transport and rela- ^ 53. The system of claim 51, wherein said ground based 

live to the ground support equipment and ground support monitoring system includes and alarm device for indicating 

vehicles may be monitored. when an unauthorized support system is in the area. 

36. The system of claim 34, wherein said location sensor 54. The system of claim 21, further including means 
is an on-board GPS system. associated with the on-board sensor for determining the 

37. The system of claim 35, wherein said commercial format of the signal communication system of the ground 
transport is adapted for directly receiving the ground support 30 based monitoring station and further including means for 
location sensor signals. converting the signal generated by the on-board sensor to a 

38. The system of claim 36, wherein said commercial ground based system compatible signal. 

transport is adapted for directly receiving the ground support 55. The system of claim 21, further including means 

location sensor signals and the location sensor signals gen- associated with the ground based monitoring station for 

era ted by other commercial transports in the vicinity. 35 determining the signal format of the signal generated by the 

39. The system of claim 1, wherein said commercial on-board sensor and further including means for converting 
transport includes a unique identifier which is adapted to be the signal generated by the on-board sensor to a ground 
sensed by the ground based sensor, whereby the ground based system compatible signal. 

based sensor can generate an identification signal for alert- 56. The system of claim 21, further including means for 

ing that the commercial transport is within range of the 40 accessing and controlling system on-board the commercial 

ground based sensor. transport from the ground based monitoring station. 

40. The system of claim 14, wherein said image and video 57. The system of claim 1, further including a personnel 
sensors are responsive to the presence of activity within based unit including at least one sensor and a personnel 
range in order to activate the sensor and initiate generation communications system capable of transmitting and receiv- 
of a signal to the ground based monitoring station. 4S ing information to and from the ground based communica- 

41. The system of claim 1, wherein said ground based tions system for monitoring conditions present at the sensor, 
sensor includes a time stamp for monitoring when said 58. The system of claim 56, further including ,a personnel 
transport is within range. based system for generating the location coordinates of the 

42. The system of claim 1, wherein said ground based personnel and communicating this to the ground based 
sensor is carried on-board the transport for deployment in communication system. 

the port once the transport enters same. 59. The system of claim 57, further including a location 

43. The system of claim 1, wherein said ground based signal generator associated with the transport, whereby the 
communication system is adapted for downloading software proximity of the transport to the personnel may be moni- 
from various system elements. tored. 

44. The system of claim 1, wherein said sensor is adapted 60. The system of claim 58, further including a signaling 
for alerting the ground based monitoring station of the 55 device for signaling the personnel in closest proximity to the 
situational conditions in the vicinity of the commercial transport upon the receipt of specific signal from the sensor 
transport when in port. by the ground based communication system. 

45. The system of claim 43, wherein said sensor is 61. The system of claim 59, wherein said personnel based 
adapted for generating an alarm whenever specific condi- system includes means for remotely controlling the sensor, 
tions are present. 60 62. The system of claim 60, wherein said personnel based 

46. The system of claim 44, wherein said ground based system includes means providing for communication 
monitoring station further includes a transmitter for trans- directly between the transport and the personnel, 
mitting instructional information to the sensor upon pres- 63. The system of claim 61, wherein said personnel based 
ence of a specific condition. system includes means providing for communication 

47. The system of claim 1, wherein the sensor is respon- 65 directly between personnel, 
sive to thc presence of specific conditions to generate the 

unique signal. ***** 
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